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Abstract 



^ ' We proved the explicit formulas in Laplace transform of the hitting times for 

n , , the birth and death processes on a denumerable state space with oo the exit or 

entrance boundary. This extends the well known Keilson's theorem from finite 
state space to infinite state space. We also apply these formulas to the fastest 
strong stationary time for strongly ergodic birth and death processes, and obtain 
the explicit convergence rate in separation. 
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^ 1 Introduction 

In this paper, we will study the passage time between any two states of an irreducible 
/S I birth and death process on the nonnegative integers {0, 1, 2, ■ ■ ■ }. A well-known theorem 

d ■ states that the passage time from state to state d{< oo) is distributed as a sum of d 

independent exponential random variables with distinct rates. These rates are just the 
non-zero eigenvalues of the associated generator for the process absorbed at state d. This 
is a well-known theorem usually attributed to Keilson([15]), and it may be traced back 
at least as far as Karlin and McGregor ([I3]). See Diaconis and Miclo |6] for historical 
comments. 

Very recently. Fill [10] gave a first stochastic proof for the result via the duality. An 
excellent application of this theorem is to the distribution of the fastest strong stationary 
time for an ergodic birth and death process on {0, 1, ■ ■ ■ , d}. And it is also the starting 
point of studying separation cut-off for birth and death processes in [7]. By the similar 
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method, Fill proved an analogue result for the upward skip-free processes ([H]). Diaco- 
nis and Miclo [6] presented another probabilistic proof for it, by using the "differential 
operators" for birth and death processes([8]). 

Consider a continuous-time birth and death process (Xj)j>o with generator Q = {qij) 
on Z+. The {qij) is as follows 
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Here aj(z > 1), 6j(« > 0) be two sequences of positive numbers. 

Let Tin = inf {t > : Xf = n\XQ = i} be the hitting time of the state n starting from 
the state i. The well known theorem of Keilson([T5]) is the following. 

Theorem 1.1. Let X^ < ■ ■ ■ < An be all (positive) n eigenvalues of —Q^^\ where 
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Ctn-l —[O-n-l + bn-l) J 



Then To^n is distributed as a sum of n independent exponential random variables with rate 
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We will investigate the distribution of the hitting time Tj ^ for the birth and death 
process Xt on the nonnegative integers. This includes four cases: 

Case I: < z < ra < 00; 

Case II: 0<n<'i<A^< 00, where A^ is a reflecting state; 

Case III: < z < n = 00; 

Case IV: < n < z < 00. 



Cases I&II are really easy consequence of Theorem 11.11 since the distributions are 
actually involved in finite states. This will be done in the next section. Indeed, for Case 
I, by using the property of the birth and death process and the strong Markov property, 
we can obtain the explicit formula for any < i < n < 00 from that of T^^n in Theorem 
11.11 See Corollary 12.11 below. For Case II, since A^ is a reflecting state, we can get the 
distribution of Tj^„(0 < n < i < N) from Case I via turning left-side to right, that is, we 
can take the mapping on the state space: j — )■ j' : j' = N — j . See Corollary 12.21 below in 
Section 2. 



When we deal with the birth and death process on Z_(_, we will face the classification 

of the state oo at infinity concerning uniqueness, due to Feller ([8]). See also [21 Chapter 

8] for more details. According to [8], there are four types of the oo boundary: regular, 

exit, entrance and natural boundaries. 

Define 

bobi---bi^i 

llQ = 1, /ii = , I > 1, (1.4) 

aia2 ■■ -tti 

and /i = Xl^i Atj- 
Let us also define 
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The oo boundary is called exit if i? < oo, 5 = oo; entrance if i? = oo, S* < oo. What we 
will do in this paper is to give distributions of Tj^oo for the birth and death process with 
the exit boundary and that of Tj^„(2 > n) for the entrance boundary. 

The another difficulty for infinite birth and death processes is obviously how about 
all the eigenvalues or the spectrum of the generator. By the spectral theory established 
in [16] and ^7\, we can eventually overcome the difficulty. Briefiy speaking, we give 
distributions of To^oo(the life time) for the minimal birth and death process corresponding 
to Q when oo is the exit boundary. We will use a procedure of approximation with 
n — > oo to derive the distribution of To oo from that of T^n in Theorem 11.11 To deal with 
the eigenvalues for birth and death processes in infinite state spaces, we should utilize the 
powerful theory of Dirichlet form. Dirichlet form helps one obtain the variational formulas 
for eigenvalues, and more importantly provide the approximation procedure. The similar 
situation appears when oo is the entrance boundary, from a view point of [13] on the 
duality method. The duality method was used successfully in [5] to study the estimation 
of the principal eigenvalue for birth and death processes. 

To end this section, we mention the Dirichlet form concerning birth and death pro- 
cesses. Let 



D{f) = Y,fiMf^-f^A 



ij ) 



j=0 



and ^"'''^{D) = {/ G T^(yu) : D{f) < oo}. Then it is proven in [5l Proposition 1.3] that 
(-D, ^^^"^(D)) is regular if and only if 
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In other words, the Dirichlet form corresponding to Q is unique iff ( 11. 6p holds. 

We remark that when oo is the exit or entrance boundary, the Dirichlet form is unique. 
Indeed, from [21 Section 8.1], we know that the equivalence condition for the exit boundary 
is i? < oo, /i = oo, ^^0 ^/f^i^i < '^j ^h^ equivalence condition for the entrance boundary 
is S* < oo, /i < oo, Xli^o ^/f^i^i — ^^- Thus in any case, (I1.6P holds. For regular boundary 
{R < oo,S < oo), the problem is that the Dirichlet form is not unique. We need to 
develop new technique other than that used in this paper. For the natural boundary 
{R < 00,5" = oo), the situation is different. Although the Dirichlet form is unique, we 



will face the difficulty of the essential spectrum problem. So the formula must be totally 
different from that in this paper. 

The rest of the paper is organized as follows. In Section 2, we derive the distributions 
of the hitting times Tj^„ for finite birth and death process from Theorem 1 1.1[ In Section 3, 
we give the distribution of the life time for the birth and death processes with oo the exit 
boundary, starting from any i > 0. In Section 4, we give the distributions of Tj „(i > n) 
for the birth and death processes with oo the entrance boundary. And finally in Section 
5, the distribution of the (fastest) strong stationary time is derived and we also study the 
convergence in separation for the process. 

2 The finite state space 

Let's ffist solve Case I from Theorem ll.il 
Corollary 2.1. For < i < n < oo, 

-I--I-7TTW 

Ee-T,„ ^ ^^=11+^ > Q_ (2.1) 
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In particular, 



^^o,n = E i' ^^- = E i - E TTO • (2.2) 



l<u<n '^i' l<u<n ■^^ l<v<i "^i^ 



Proof. Since To_„ = Tq^j + Tj^„ by the property of the birth and death process and Tq^j, Tj_„ 
are independent by the strong Markov property, the corollary follows immediately from 
Theorem 11.11 

(12. 2 p follows from (12. ip by a standard method to derive the moments from the Laplace 
transform. D 

We remark that (12. 2p can be called the eigentime identity for absorbed birth and death 
processes. Cf. [17]. It is different from that in [U Chapter 3], where the eigentime identity 
for the ergodic finite Markov chain is involving in the average hitting time. In [16], this 
kind of eigentime identity for the continuous-time Markov chain on countable state space 
was studied. See Section 5 below. 

For < n < A^ < oo, let A^ 1 < A^2 < ■ ■ ■ < ^nN-n ^e the positive eigenvalues of 
-Qn , where 



Qf^: 



/ -(On+l + bn+l) bn+1 

O'n+2 —{0'n+2 + bn+2) ^n+2 
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This is the generator of the birth and death process on {n, 
n and reflecting state N. 
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As we mentioned in the last section, by taking the mapping on the state space: j -^ 
j' : j' = N — j , we can easily obtain the following results from Theorem 1 1 . 1 1 and Corollary 



Corollary 2.2. For 0<n<i<N<oo, 
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E^ = E^^- = E;^E-^- (2-4) 

Proof. The second equality in (12 ■4p can be found on [21 Page 264]. D 



3 oo is the exit boundary 

In this section, we will derive the life time distribution for the minimal birth and death 
process when Q-processes are not unique. Let's recall the facts about the uniqueness of 
birth and death process, see for example [2], [3]. And then we will study the spectral theory 
for the minimal birth and death processes. The spectral theory helps us pass from finite 
states to infinite states, especially we will establish what are the limits of the eigenvalues 
for finite birth and death processes when the states go up to the infinity. 

When R < oo, the corresponding Q-processes are not unique, for details see [21 Chapter 
8] or [51 Chapter 4]. Let {Xt,t > 0) be the corresponding continuous-time Markov chain 
with the minimal Q- function P{t) = {pij{t) : i,j G E), that is, 

p,,{t)=F,[Xt=j,t<C] 

with ( = liran^ooCn the life time, where C,n be the successive jumps: 

eo = o, en = mf{t:t>en-i,^i7^^c„-J' ^>i- 

Proposition 3.1. (i) When staring from the state 0, the life time ( = lim„_j,oo To^„ a.s. 
(ii) Pj[C = C)o] = 1 or for any i & E and Kq( = R. 

Proof, (i) Let Xq = 0. Note that ( is the (first) time that the process jumps infinite 
times, for any n, before To,„ the process jumps only finite times, so that ( > Tq^u for any 
n. Thus ( > lim„^oo 7o,„ a.s. Conversely, since the birth and death process jumps once 
to two nearest neighbors, then ^„ < To,„ for any n. Thus ( = lim„_j.oo ^n < hnin^oo ^o,n 
a.s. 

(ii) See |21 Chapter 8] or [21 Chapter 4]. D 



Denote by I/^(/^) the usual (real) Hilbert space on E = {0,1,2,---}. Then it is well 
known that Q^^\Q,P{t) are self-adjoint operators on L'^{ij). For a self-adjoint operator 
A on I/^(/i), denote a{A),aess{,A) respectively the spectrum and the essential spectrum 
of A. Here, the essential spectrum consists of continuous spectrum and eigenvalues with 
infinite multiplicity. When crcss(Q) = 0, denote by Ai < A2 < ■ ■ ■ all the eigenvalues of 
—Q. Actually, all the eigenvalues under consideration in this paper are of one multiplicity, 
for this see Theorem 13.41 below. 

The following result in |T7] is our start point of the spectral theory for the minimal 
birth and death process. 

Theorem 3.2. If R < 00,6* = 00 (the exit boundary), then P(t) is a Hilbert- Schmidt 
operator for any t > 0. So that CcssiQ) = and 

n>l 

To get the distribution of the life time, we need the following minimax principle 
for eigenvalues, which is a variant of classical Courant-Fischer theorem for symmetric 
matrices. See for example [121 P-149]. 

Proposition 3.3. Assume that o-cssiQ) = 0- Let \v{h' > 1),A1/" (1 < u < n) be eigenval- 
ues for —Q^"^' in M-l\) and —Q in M.2\) respectively. Then for u > I 

K= max min{D(/):/i(/') = l,/i(//.) = 0,1 <?<//}. (3.1) 

and for 1 < u < n 

A(")= max min {D(/) : /I [„,„,) = 0,/i(/') = l,/i(//.)= 0,1 <?<//}, (3.2) 

/i,---,^-iGL'^(m) 

Proof, a) We prove the assertion for Aj, first. Let e^ be the corresponding eigenfunction 
for \^, then 

K = inf {D{f) : /i(/2) = 1, /i(/e,) = 1, 1 < j < z/} . 

Since / = Yl'jLif^if^j)^j ^^^ —Q^j = ^j^j, then 

00 

D(/) = /i((-Q/)/) = EV(/e,)', 

so that for /j G L^(/i)(l <i<u), 

inf {Dif) : /i(f ) = 1, ^^{ff,) = 0,l<t<u} 

{00 
Y, XMfe.f ■■ Kf) = 1, /i(//^) = 0, 1 < 2 < z/ 

< inf i X^ A,(/,e,)2 : /i(f) = 1,^//^) = 0(1 < ^ < z/),/x(/e,) = 0(j > u) 

< sup lY,^Af^(^j)^ ■ f^if) = l'Ai(/ej) = 0,j > z/ 
= X.. 

6 



Therefore, 

A, > max min {D{f) : fi{f) = 1, /i(//,) = 0, 1 < ^ < z/} . 

/i,---,/i'-iGL2(/i) 

If we choose fi = ei,l < i < u, the above equahty holds, 
b) For /|[„,oo) = 0, 

n-2 

D{f) =J2f'Mfi - f\+lf + f^n-lbn-lfn-l =: D'-^'' (f) , (3.3) 

j=0 

then it's easy to check that D^'^\f) is Dirichlet form for Q^"^ in (11.21) . The rest of the 
proof is the same as above. D 

Let 

J^ = {/ : / has finite support} . (3.4) 

Define 

oo 
i=0 

with the minimal domain &{D) consisting of the functions in the closure of J(f with 
respect to the norm || ■ ||d '■ I I/I Id = /^(/^) + D{f). In this paper, we deal with the 
minimal Dirichlet form or the minimal processes, cf. [3l Proposition 6.59]. 

Theorem 3.4. Assume that R < oo, S = oo, then 

Moreover, all eigenvalues \^ are distinct (each of one multiplicity) . 

Proof, a) We use Proposition 13.31 to prove the monotonicity for \v . For any fixed 
1 < z/ < n and /i,--- , ^_i G L'^{^J), if / is such that /|[„,oo) = 0,/i(/2) = l,/i(//i) = 
0, 1 < 2 < z/, then /| [„+i,oo) = 0, /i(/2) = 1, /i(//») = 0, 1 < i < z/, so that 

min{D(/) : /|[„,,o) = 0,/i(/2) = 1, /.(//,) = 0, 1 < z < z/} 

> min {D(/) : /|[„+i,oo) = 0,/i(/2) = l,/i(//,) = 0, 1 < z < z/} 

and AiT > Xh for \ < u < n. This proves the monotonicity. Thus the limit 
lim„_^oo K ='■ At, exists for any z^ > 1. 

b) As pointed in Section 1, when R < oo, fi = oo, {D,S){D)) is a regular Dirichlet 
form. That is, let 

^max(l^) = {fe L\fi) : D{f) < oo} , 

and (D, ^max(-D)) be the maximum Dirichlet form, then S){D) = ^inax(-D). Therefore, 
when R < oo,/i = oo it follows from Proposition 13.31 that 

A. = max min {D{f) : / G JT, fi{f') = 1, /i(//,) = 0, 1 < 2 < z/} . (3.5) 

/i,---,/^-i6-L^(m) 



c) On one hand, we have A^ < A,^. Indeed, it follows from fl3.5p and monotonicity that 
for u > 1, 

K = max min {D{f) -.feJt, fi{f) = 1, /i(//,) = 0, 1 < z < z/} 

max min {D{f) : 3n > 0, f \[n,oo) = 0; fi{f) = 1, fiiffi) = 0,1 < I <iy} 

fi,--- ,U-i<^L^ii) 

= max 'mimm{D{f) : f\[n,oc) = 0,fi{f) = l,iJ,{ffi) =0,l<i <i^} 

/ir-- Ji'-ieL-i(^)n>l 

< inf max min {£>(/): /|[„,oo) = 0,^(/^) = l,/i(//,) = 0, 1 < z < z/} 

= lim max min {£)(/): /|[„,oo) = 0,/i(/^) = 1, /i(//i) = 0, 1 < z < z/} 

n^oo/i,...,/„_iGL2(/^) 

= lim A|r^ = K. 
On the other hand, from Corollary 12.21 we have 

l<v<n ■^'^ l<u<oo -^^ 

then it follows from monotone convergence theorem that 



But we already know from Theorem 13.21 that 

R= J2 f <oo. (3.7) 

l<u<oc 

Since A^, < A,y(z/ > 1), it must hold that A^, = Xi, for any z/ > 1. 

d) Next we will prove that all eigenvalues {Aj,, z/ > 1} are distinct. For this we only 
need to prove that the eigenspace for any X^, is of one dimension. Indeed, let —A be an 
eigenvalue and g the corresponding eigenf unction. From Qg{i) = —Xgi,i > 0, we have 

boidi - 9o) = -Afi-o, ai{gi_i - gi) + 6i(fi'i+i - g^) = -Xgi, i > 1. (3.8) 

Since yUj6j = /ij+iaj4.i(i > 0), it follows from (13.81) that 

A ' 



9k+i = 7- ^ i^-igi + gk,k> 0. 



(cf.[5]) This means that eigenfunction g is determined uniquely once go is given. 



D 



Remark 3.5. For the first eigenvalue {i^ = 1), it was proved by Chen M.-F.(2009) without 
the assumption CessiQ) = in case that Ai is defined by the classical Poincare variational 
formula: 

J]M(/. - f^+l? : / e ^,^/i,/^ = 1 [ . 
«=0 1=0 J 



Theorem 3.6. Assume R < oo, S = oo. Let ( be the life time for the m,inim,al process, 
then 

oo , 



And for any z > 0, let Ti^o = linin_s.oo Ti n, then 



n '■ 



_ s + Xi, 
EiC""^ = Ee^"^'-°° = -^^ , s > 0. 

u=l S -\- Au 

Proof. The assertions follow from the monotone convergence theorem and Proposition 
13.11 Corollary 12. H Theorem 13.41 D 

For the exit boundary, the distributions of Tj „ for < z, ra < oo are all known. When 
< i < n < oo, the distribution is given by Corollary 12. ![ while < z < n = oo, the 
distribution is given by Theorem | 



4 (X) is the entrance boundary 

In this section we will deal with Case IV for the birth and death process with oo the 
entrance boundary, i.e. i? = oo, 5 < oo, and the corresponding Q-process is unique. 

Since 5* < oo, ;U < oo. Let ttj = fii/ fi, then n = (tt-j, z > 0) is a probability measure on 
E, so that the process is reversible with respect to ir. Now we will consider the spectral 
theory for operators on Hilbert space i^^(vr). 

For n > 0, let 



(a„+i + bn+i) bn+i \ 



Qn = O'n+2 —{o.n+2 + ^n+2) bn+2 



(4.1) 



/ 



be the generator of the birth and death process absorbed at state n. 

Let vr*^"'' = (vTj : 2 > n) and En = {n + 1, n + 2, ■ ■ ■ }. It is easy to check that Qn is 
symmetric with respect to 7i{n) and then Qn is a self-adjoint operator in L'^{En,T^^^^)- 
When (TcssiQn) = 05 denote by A„^i < \n,2 < ■ ■ ■ all the positive eigenvalues of —Qn, as 
we know from Theorem 13.41 that each eigenvalue is of one multiplicity. When n = 0, the 
subscript is dropped. 

Theorem 4.1. For the birth and death process with oo the entrance boundary, i.e. R = 
oo, S < oo, then acss(Qn) = 0; and for any n > 

oo , oo 

^-=E7^E-^ = E^ni<°«- (4-2) 

j—n ] 3 i=j-(-l i/>l 



Proof. It follows from [THl Theorem 1.4] that crcss(Q) = and J2,,>i -^z/^ < oo, where 
Q is defined by ( II .ip and {A^^ : z/ > 0} is spectrum of —Q in -^^(vr) with Aq = 0. But since 
Q and Qn differ only from a finite states, their essential spectrum is same (se for example 
p3| Theorem 5.35 on page 244]). 

Now we prove the identity in (14. 2p . Let for i,j > n 






p'i;\t)dt. 



By a similar method as in the proof of [171 Theorem 1.4], we can get that 

1 



zl ^".^^ ~ zl ^^ ~ zL 



v>\ i>n i>n ^ / L i J 

Here r^ = inf {t > the first jump time : Xt = j} is the return time. Note that once [t^ = 
oo|Xo = i] happens, it must first jump to state i — 1, otherwise it can be back to state i 
in finite time almost surely since the original Q-process is ergodic. Next when it comes 
to state i — 1, it must arrive to state n before it arrives state i. Thus we have 

P,[r+ = oo] = ^i-P,„i[7^„i^„ < r+], 
tti + bi 

and by a standard martingale method and letting Si = Ylj<i{'^j^j)~^ t)e the scale function 
(see for example [211 Theorem 4 in §7.11]), we obtain 



Pi-l[^i-l,n < Tj 



Sz - Si_i ifJ'i-lbi-l) ^ iflitti) ^ 



Therefore 



oo 



i/>l i>n n<.'j<i ■' ■' j='n •' •' i=j+\- 



D 



As in the last section, we also need the minimax principle for eigenvalues of Qn- 
Proposition 4.2. For < n < N < oo, let 

N-l 

^f H/) = /i(-/QifV) = E ^'Mf^ - h+lf + /in&n/„%i. 

i=n+l 

Then for 1 < u < N — n 

A(fj = max min{Df )(/) : /i(f ) = 1,M//.) = 0,l<z<u}. (4.3) 

/i,---,/^-ieL2(^) 

Proof. The proof is direct and is omitted. D 

Proposition 4.3. Assume that aessiQ) = 0- Let \n,u be eigenvalues for —Q^"^^ in ^.1\) . 
Then for u > 1 

K,u = max min {D{f) : /[o,„] = 0, /i(f ) = 1, //(//,) =0,l<t<u}. (4.4) 

10 



Proof. Since D{f) = T,Zn+il^Mfi - fi+if + l^nKfu+i = K-fQnf)- The rest of proof 
is similar to that of Proposition 13.31 D 

We need the approximation procedure when A^ — )■ oo. For this purpose, we need to 
do more. 

Fix n > and define 

J^= {/ e L~ : {/ ^ 0} C {n + 1, ■ ■ ■ , A^} for some A^} . (4.5) 

and Xl = ig := cf + d : f e 3F,c,de m}. Define 

oo 

D{f)=Y,^^^Hfi-f^+l? 
i=0 

with the domain ^{D) consisting of the functions in the closure of J^ with respect to 

the norm II -lb: 11/11,3 = /^(/') + !)(/). 

Since oo is the entrance boundary, the Dirichlet form is unique as explained in Section 
1, thus ^{D) = ^'^''''{D) = {f e L'^ifi) : D{f) < oo} and we can rewrite dO]) as 

Xn,. = max min {d(/) : / G ii, /i(/') = 1, /i(//,) = 0,l<t<A. 

This leads to 

Theorem 4.4. Assume that R = oo, S < oo, then 

Vz/ > 1, A^fJ i Xn,u as N ^oo. 
Proof, (a) Let / G ^l, assume that f[N,oo) = c, then 

oo oo 

D{f) = ^flAifi - fi+if = Y^ ^ihi{fi - fi+if + finbnfn+l 
i=0 i=n+l 

= E ^'Mf^ - U+lf + ^^nhnfl^, = Di''\f). 

i=n+l 

Here in Dn (/), / is viewed as a function on {n + 1, ■ ■ ■ , A^}. From this, we can easily 
deduce the monotonicity of XnJ in A^. 

(b) By Theorem 9.11 in [3] and Proposition 14.31 above, we have that for u >1, 

A„,, = max min |d(/) : / G ii,/i(f ) = l,/i(//.) = 0, 1 < z < i^j 

= max min {L)(/^)(/) : 3A^ > n, /I [AT^oo) = constant; /i(/^) = l,/i(//i) = 0,1 < i < z/} 

< lim max min [D^^^f) : /|[Ar,oo) = constant, yu(/^) = l,fi{ffi) = 0,1 <i < u} 

= lim A^fj := an,u- 



11 



(c) It follows from (EID in Corollary O that 

N , N 



j=n -' -^ i=j-\-l 

from which by letting A^ — )■ oo we have 






oo ^ oo ^ 



But for any u > 1, A„_j, < a„_j, and it follows from Theorem 14. 1 1 that 

oo ^ oo ^ 

Thus it must hold that \n,u = Oin,u = liniAr-s>oo KiJ for any v >1. 



U 



Theorem 4.5. Assume the birth and death process is such that oo the entrance boundary. 
For n > 1, we have 

oo 'T" 

Ee-^^-o = ^i^i^,s>0. (4.6) 



n 



Let Too,o = linin^oo7'„„o, then 

oo 'T" 

Ee-«r-,o ^ -Q ^^^ ^ > 0. (4.7) 

Proof, a) By using the monotone convergence theorem, we can get (14.61) from Theorem 
14.41 and Corollary 12.21 immediately. 

b) To pass from (14.61) to (14. 7p . we only need to show that lim„_i,oo Xn,i = oo, so that 
Xn,u tend to infinity uniformly in j/ > 1 as n — > oo. This is a consequence of [T6| Corollary 
1.1] and [m Theorem 3.4]. D 

For the entrance boundary, the distributions of Tj^„ for < i, n < oo are all known. 
When < ? < n < oo, the distribution of Tj^„ is given by Corollary 12. H while < i < n = 
oo, Tj^oo = oo a.s. since the life time C = oo a.s. When < n < i < oo, the distribution 
of Ti^n is given by Theorem 14. 5[ 



5 Application to the fastest strong stationary time 

In this section, we apply the theorems to the strong stationary time. We give the distri- 
bution to the fastest strong stationary times, and then study the exponential convergence 
in separation for the birth and death process. 
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First of all, we would like to recall some facts about the strong ergodicity for the birth 
and death process. 

Let T be the average hitting time: T = Xlij ^«^i^E^«,i- (cf-[Il Chapter 3]) From [21 
Chapter 8], we can eventually calculate out that (cf. [16]) 



oo ^ A: oo 

fc=0 i=0 i=k+l 

In the following theorem, we summary the facts of strong ergodicity. 

Theorem 5.1. Assume that the process is unique (i.e. R = ooj. The following statements 
are equivalent. 

(i) S<oo. 

(ii) The process is strongly ergodic. 

(iii) T < oo. 

(iv) (Tcss(Q) = and Y.u>i K^ < ^• 
Furthermore, when (JcssiQ) = 0; then 

Proof. The equivalence of (i) and (ii) was proved in [22] and the other assertions were 
prove in [16]. D 



Now we study the distribution of the strong stationary time for the strongly ergodic 
birth and death process. A strong stationary time (SST) is a (minimal) randomized 
stopping time r for Xt such that Xr has the distribution vr and it independent of r. 

With the aid of Theorem 13.61 and the duality established in [9], we can obtain the 
following result, which extends the result in [TD] to the denumerable case. 

Theorem 5.2. For a strongly ergodic birth and death process (i.e. R = oo, S < oo^, the 
SST T has distribution 

where {A^ : i^ > 1} are the positive eigenvalues of ~Q for the strongly ergodic birth and 
death process. 

Proof. We follow the argument in [9l Section 3.3] with a minor modification. Let 

j<i 

where iij = fij/fi is as before. Then < l//i = ttq < i/i < 1. 

Define the dual Q*-hiTth and death process with parameters (a*, 6*) given by 

«i = -n-^^^ ^i = —n-<^i+i- (5-1) 

-nj rli 
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Also 

,_ K---bU _ bo Hf 
^' a^ ■ ■ a* fiih Hi ' 

Note that Hi > Hq, we have 

E* ■^^ bo iij ■^-^ bo Ui sr-^ bo sr-^ 

and as 1/yU < Hj < l,/ij6j = /ij+iOj+i, 

oo oo , 

^ l4b* ^ ^' ^ boH,H,+, ^ fi.b. ^ 

i=0 ^^ « j<i j=0 ^ ^ j<j ^-^ -^ 

oo tt2 

Thus the (5*-process (miniinal process) is with oo the exit boundary and r has the same 
distribution as the hfe time (* (the time attaining oo) for (5*-process. Applying Theorem 
13.61 we have 

oo 



Eoe""" = Eoe-"'^* = JJ 



1 s + K 

u=l "^ 

where {A*, i^ > 1} is spectrum of —Q*. To complete the proof, it suffices to prove that 
A* = A^ for v>l. 

Actually, let the link matrix A = (Ajj) as Ajj = ly<i:^7rj/Hi, then AQ = Q*A. This 
means that Q has the same spectrum in L^{fi) as Q* in L'^{fi*). But as proved in Theorems 
13.21 and |5.H the spectra are all eigenvalues, so that A* = A^, for u > 1. D 

Theorem 15.21 enables one to obtain the unform convergence in separation. Actually we 
will prove that the uniform convergence in separation is equivalent to the strong ergodicity 
for the birth and death process. 

Let Pij{t) be the transition function for the birth and death process with stationary 
distribution tt, define the separation: 

Si{t) = sup ( 1 - M^ J ^i > o,t > 0. 

For the elementary properties of separation, see [9]. For example, we have the following 
relation for total variance distance and separation: 

Ibi.(t) -vrllvar := J^b.iW -7r,-| < s,(t). (5.2) 

j 

The main theorem in [9] (see also [lOl Proposition 1]) says 

Si(t) <Pi[r >t],VO < t < oo. (5.3) 

This leads to study the distribution of r starting from any state other than 0. 
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Proposition 5.3. Let r be the SST in Theore'm \5.^ and Xt he the Q-process and X* be 
the minimal Q* -process with Q* given by Ii5.1\) . Then for t > 

n[r<t]=¥o[C<t], (5.4) 

and for i > 1 

^^[r <t] = ^H,F,[C <t]- i7.-iP.-i[C* < t]\. (5.5) 

Consequently, for i > l,Ejr < Ej_iC* < EqC* and 

supEjr = Eor. (5.6) 

Proof. The proof of (15. 4p can be found in |9]. We will prove (15. 5p . Let m and m* be the 
distribution of Xq and Xq respectively, it follow from [9l Proposition 4] that if m = m*A, 
then 

K:[r<t] = Fm4C<t]. (5.7) 

For any i > 1, let m* = 6i the Dirac measure, then ruk = ^l[o<fc<j] and equality (15. 7p 
implies that 



0<k<i 

Thus 



5^ ^Pfc[r <t]= m* < t] or Yl ^'^^'^[^ ^ ^] = ^^^-'tc* < ^]- 

0<fc<i * 0<fc<i 



Pjr < ^] = ^<i H,F,[C <t]- //._iP.-i[C* < t] \. 



Since Pi[C* ^ t] increases in i > 0, we have 

P.[r < t] > ^|if.Pi-i[C* <t]- if.-iP.-i[C* <t]\= P.-i[C* < i] > Po[C* < t]. 

Thus 

P^[r>t]<P.-i[C>t]<Po[C>t], 

which imphes 

EiT= Fi[T>t]dt< P,_i[C* >t]dt = E,_iC <EoC. 
Jo Jo 

Corollary 5.4. l^e have for any i > 

Eq/ < {EqtY/H (5.8) 

and /or any A < I/EqT 

Eoe^^ < (1 - AEor)^^ (5.9) 



D 
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Proof. Since from fIS.Sp . r and (* have the same distribution under Eq, we need only prove 
(15. 8 P with r replaced by (*. It follows from [T71 Lemma 4.1] that for any £ > 

MiCY] < (EoC*)7^! 

Eoe^^ < (1 - AEor)"^ 

D 



and for any A < I/Eqt 



Theorem 5.5. Let 

S(t) = supsj(t), 

i 

and T be the SST in Theorem \5.S[ Then the following statements are equivalent. 

(i) The process is strongly ergodic. 

(ii) r < oo a.s. 

(iii) EoT < oo. 

(iv) limt^oo 'S'(t) = 0. 

Proof. The equivalence of (i)-(iii) follows from Theorems 15.21 and 14. ![ and Proposition 15. 3[ 
We will prove the implication of (iii)=^(iv) and (iv)^(i). 

(a) Suppose that supjE^r < oo. By duality, we have EqC* < oo, it follows from fl5.3p 
and Markov inequality that 

^/ N ™ r 1 sup,-E,-r EnT 

^(t) < sup Pjr > t] < ^' ' <^^0, t^oo. 

i it 

(b) Suppose limt^oo S{t) = 0. It follows from the inequality (15. 2p that 

SUp||pi.(t) -7r||var < ^(t) -^ 0, t -^ OO, 
i 

which is strong ergodicity. D 

We remark that under any assumption of (1) — (4) above, letting 

/3 = sup {e:3C < oo, S{t) < Ce~'\ Vt > O} 

be the optimal convergence rate in separation, then it follows easily from Corollary 15.41 
and Theorem 15.11 that 

^ / oo \ ~ / oo k oo 

\u=l / \fc=0 «=0 j=fc+l 
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